Dead pixel test using effective receptive field

نویسندگان

چکیده

Deep neural networks have been used in various fields, but their internal behavior is not well known. In this study, we discuss two counterintuitive behaviors of convolutional (CNNs). First, evaluated the size receptive field. Previous studies attempted to increase or control However, observed that field does describe classification accuracy. The would be inappropriate for representing superiority performance because it reflects only depth kernel and reflect other factors such as width cardinality. Second, using effective field, examined pixels contributing output. Intuitively, each pixel expected equally contribute final found there exist a partially dead state with little contribution We reveal reason lies architecture CNN solutions reduce phenomenon. Interestingly, general tasks, existence improves training CNNs. task captures small perturbation, degrade performance. Therefore, these should understood considered practical applications CNN.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Understanding the Effective Receptive Field in Deep Convolutional Neural Networks

We study characteristics of receptive fields of units in deep convolutional networks. The receptive field size is a crucial issue in many visual tasks, as the output must respond to large enough areas in the image to capture information about large objects. We introduce the notion of an effective receptive field, and show that it both has a Gaussian distribution and only occupies a fraction of ...

متن کامل

Temporal receptive field estimation using wavelets.

A standard goal of many neurophysiological investigations is to obtain enough insight into a neuron's behavior that it becomes possible to predict responses to arbitrary stimuli. Techniques have been developed to solve this system identification problem, and the numerical method presented here adds to this toolbox. Stimuli and responses, beginning as functions of time, are transformed to comple...

متن کامل

Object Recognition Using Multidimensional Receptive Field Histograms

This paper presents a technique to determine the identity of objects in a scene using histograms of the responses of a vector of local linear neighborhood operators (receptive elds). This technique can be used to determine the most probable objects in a scene, independent of the object's position, image-plane orientation and scale. In this paper we describe the mathematical foundations of the t...

متن کامل

Receptive Field Encoding Model for Dynamic Natural Vision

Introduction: Encoding models are used to predict human brain activity in response to sensory stimuli. The purpose of these models is to explain how sensory information represent in the brain. Convolutional neural networks trained by images are capable of encoding magnetic resonance imaging data of humans viewing natural images. Considering the hemodynamic response function, these networks are ...

متن کامل

Collaborative Receptive Field Learning

The challenge of object categorization in images is largely due to arbitrary translations and scales of the foreground objects. To attack this difficulty, we propose a new approach called collaborative receptive field learning to extract specific receptive fields (RF’s) or regions from multiple images, and the selected RF’s are supposed to focus on the foreground objects of a common category. T...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Pattern Recognition Letters

سال: 2023

ISSN: ['1872-7344', '0167-8655']

DOI: https://doi.org/10.1016/j.patrec.2023.02.018